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BIRKHOFF SUM FLUCTUATIONS IN SUSBSTITUTION 
DYNAMICAL SYSTEMS 

ELLIOT PAQUETTE AND YOUNGHWAN SON 


Abstract. We consider the deviation of Birkhoff sums along fixed orbits 
of substitution dynamical systems. We show distributional convergence for 
the Birkhoff sums of eigenfunctions of the substitution matrix. For non¬ 
coboundary eigenfunctions with eigenvalue of modulus 1, we obtain a central 
limit theorem. For other eigenfunctions, we show convergence to distributions 
supported on Cantor sets. We also give a new criterion for such an eigen¬ 
function to be a coboundary, as well as a new characterization of substitution 
dynamical systems with bounded discrepancy. 


1. Introduction 

Let A be a finite set of letters. Let A* be the collection of all finite words using 
letters from A. Let 0 be a substitution on A, i.e. a map from A —^ A*. This can be 
extended to a map from A* —>■ A* by concatenation, i.e. for all ai ■ ■ ■ Ok € A*, we 
define 

0(aia2 ■ --ak) = 0(01)0(02) • • • 0 (ofc). 

Define to be all the sequences using elements of A, and we can extend 0 further 
to map from A*^ —t A^, again by concatenation. Also, for any finite or infinite word 
u = U1U2 ■ • ■ , we let = U1U2 ■ ■ ■ Mfc-i, with m<i the empty word. We further 
define u<k analogously. 

Define a map (£(•)) : A* —^ which for any word w = 0102 ■ • • Ofc and any 

o G A, 

iiiw))a = |{1 < * < fc : Oi = a}| . 

Define the 6 -matrix M associated to 0 as the |A| x |A| integer valued matrix so 
that Ma^b = for all a,b & A, that is the number of occurrences of o in 

0 ( 5 ). A substitution is called primitive if there is a number A: > 0 so that > 0 
for all a,b ^ A. We will assume from here on that 0 is a primitive substitution. 

An infinite sequence u = (un)^! G A^ is called a fixed point if there is fc G N 
such that 0 ^(u) = u. In general, one can find a G A and fc G N such that 0 ^(o) 
begins with a. It is easy to check that u = limm_>oo 0 ^"‘(a) is a fixed point. 
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For any function f : A ^ C, define the map Sf : A* —>■ C by the rule that for 
any w = 0102 ■ ■ ■ ak & A*, 


Sf{w) = f{ai) + f{a 2 ) H-+ /(afc). 


Substitution systems (see Section 0] for more background), are uniquely ergodic, 
and hence for a fixed point u, we have by the Birkhoff ergodic theorem that 


lim 

N—¥oo N 



for some measure /r. 

We will study, in a sense, the first order correction term to this convergence. As 
a motivating example, consider the case of the irrational circle rotation, let a be 
any irrational number and consider any interval / = [0,x) with 0 < x < 1. Write 


Z„(iV;/)= y; 1 {0 < {na} < x} . 

l<n<N 


Then by unique ergodicity of the irrational rotation we have that 

— Za{N; I) — >■ X. 

The fluctuations of this ergodic average from x can be described by the following 
theorem of Beck. 


Theorem 1.1 (Beck [3l|4]). Suppose that a is a quadratic irrational and I = [0, x) 
has a rational endpoint x. There are constants C\ = Ci(a,x) and C 2 = C 2 {ct,x) 
such that for any real numbers —00 < t < 00 , 


1 

N 


{l<n<N: 


{Za{n; I) — nx) — Ci log N 

C2v^IoglV 


<n 



/"dx. 


This is to say that the fluctuations of the Birkhoff sum are asymptotically normally 
distributed. Recently, a new dynamical proof of the above theorem for the case 
X = ^ is obtained by studying renormalization properties of the linear flow on an 
infinite staircase [5]. 

In the case of a fixed point of a substitution, we show a central limit theorem for 
eigenfunctions f of M with eigenvalues A/ of modulus 1. For some eigenfunctions 
/, it is possible that / is a coboundary, meaning that {5'/(u<„)}^]^ is bounded. 
For these /, no central limit theorem is possible, and we give a characterization of 
eigenfunctions / that have this property in Proposition l3.ll Otherwise, if / is not 
a coboundary, appropriately scaling Sf{u<n), the fluctuations of the Birkhoff sum 
will also be asymptotically normal. We begin by giving the easiest of our theorems 
to formulate, where A/ = 1 (see Section |3] for the full formulation). 
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Theorem 1.2. Let f be a left eigenfunction of M with eigenvalue Xf = 1 so that 
f is not a coboundary. There are constants ci,C 2 so that for all real t, 

1 


lim 

N—>od IXl 


C2VlogA(iV) 


r* e-" /2 




dx. 


(Here A is the Perron-Frobenius eigenvalue of the 9-matrix M.) 


The condition that / is an eigenfunction of modulus 1 is essential to this theorem. 
Indeed, if / is an eigenfunction of modulus not equal to 1, the asymptotic distri¬ 
bution of the Birkhoff sums is non-normal (see Theorems lO and 13.21) . Conversely, 
for any eigenfunction / with eigenvalue of modulus 1 which is not a coboundary, 
we show a central limit theorem. 

The reason eigenfunctions of M play a special role here is that they satisfy a 
certain renormalization identity. Specifically, for an eigenfunction / of M with 
eigenvalue A/, we have that for any word w : 

SfiO^w)) = Xpfiw) ( 1 ) 

Hence in the case where A/ has modulus 1, words of all different scales have the 
same contribution to the Birkhoff sum, due to which we can eventually prove a 
central limit theorem. 

Let {Xg,T) be the substitution subshift of bi-infinite sequences associated to the 
primitive substitution 9 (see Section 2] for background). It is known that if 9 is 
primitive, there exists a unique ergodic measure /i on Xg. We are also interested 
in studying the behavior of ergodic sums for any point x G Xg. Indeed we show a 
central limit theorem for a left eigenfunction / of M, where / is not a coboundary 
and the corresponding eigenvalue A/ is of modulus f (see Theorem 13.41) . This 
theorem is intriguing in that the behavior of the Birkhoff sums of typical points is 
different from fixed points. 

Another approach taken by Bressaud, Bufetov and Hubert to studying fluctua¬ 
tions of Birkhoff sums is to look at Sf(v<i\je) for some sequence W oo, where v is 
distributed randomly according to /r. In this case, it turns out that this distribution 
may depend on the sequence of chosen: see [6]. 


2. Preliminaries 


2.1. Probability background. We will occasionally use probability formalism 
where convenient. We may say, for example, that Z is a real valued random vari¬ 
able with a standard normal distribution, without specifying the probability space 
or naming the probability measure. In this case, we are only interested in dis¬ 
tributional properties of Z. We will use P as a placeholder for this measure, for 
example: 




A 








4 


ELLIOT PAQUETTE AND YOUNGHWAN SON 


We will also use E to denote integration against the distribution of a random vari¬ 
able, for example 

/ —X^/2 

R 

Our main theorems are stated in terms of distributional convergence of random 
variables, or weak convergence. There are many equivalent definitions of weak 
convergence, which we will freely interchange as convenient. The equivalence of 
these definitions usually goes by the name of the Portmanteau lemma. 

Lemma 2.1 (Portmanteau lemma). Let E be a metric space and let /r, /xi, fj, 2 ,... 
be Borel probability measures on E. The following are equivalent. If they occur, we 
write fXn ^ fJ- and say that fin converges in distribution to fi. 

(1) For all bounded continuous functions /, f fdfLn —> / fdfi. 

(2) For all Lipschitz continuous functions /, J fdfin —> / fdfi. 

(3) For all measurable A with fi{dA) = 0, lim„_>oo fJ-niA) = fi{A). 

(4) If E = then for all A of the form (—oo,a;i] x ••• x (—oo,Xd] with 
fi{dA) = 0, lim„_>oo lin{A) = fi{A). 


See |131 Theorem 13.16]. 

It is also possible to metrize weak convergence. We will make use of such a 
metric later on. Define the bounded-Lipschitz metric on the space of probability 
measures on a metric space E as 


<iBL(At, u) 


sup 



ll/IU<i 

ll/llLip<l 


When i? is a separable metric space, it is a theorem of Dudley [7] that weak con¬ 
vergence is equivalent convergence in the bounded-Lipschitz metric. 

Theorems [231 Em and llO.ll show distributional convergence to a complex normal 


distribution. A complex random variable Z with mean 0 is said to have a complex 


normal distribution with positive definite covariance matrix T = 
if for any Borel measurable A C R^ 


E(5RZ)^ E(5RZaZ) 
_E(5RZaZ) E(az)^ 


p [z e A] = 


1 


27rvdetr 




' dxidx2. 


It follows from this definition that both of 5RZ and SZ are normally distributed. 
Note that Z is completely determined by E|Zp and EZ^. UFMZIsZ = 0, then the 
real and imaginary parts of Z are in fact independent normal random variables. 


2.2. Path space. Define the state space X by 


= {(«) j) ■ a € A,l < j < |6»(a)|} . 


(2) 
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(a, 1) (a, 2) (a, 3) (&, 1) (6,2) (6,3) 

1 O O O O O O 



Figure 1. Here we give a graphical representation of path space 
for the substitution 9{a) = aab, 9{h) = bba. 


Also, for each p G N, define the path space C X^ of all sequences {{vi, ki)}^^^ 
so that for all 1 < i < p, Vi = 0(ui+i)fei+i- 

We will now define a coding of the collection of strict prefixes oi w = 9'P{a). Let 
n < |0^(a)| be a positive integer. One can find Vp,Vp-i, ... ,ui G A and positive 
integers kp, kp-i,... ,ki such that 

W[i.„) = 0P-'^{9{vp)<kp) ■ 0P~‘^{9{vp-i)<k^_,)- ■ ■ 9{9{v2)<k^) ■ 9(vi)<k^, 


where 


Vp = a, 1 < fcp < |0(a)| 


and for f = 1,..., p — 1 


Vi = 9{vi+i)ki+^, ^ < ki < \9{vt)\. 

Since this expression is unique, there is an injection 'i’a,p '■ {1)2,..., |0^(a)|} —>■ X*'^ 
given by 

^a.p(R) = {vi,ki)iv2,k2) ■ ■ ■ {Vp,kp). (3) 

We also define the infinite path space X *’°° C X °° as the collection of all se¬ 
quences {{vi, ki)}'^i so that for all 1 < z < p, Ui = 9{vi+i)ki^i- l^is space, 
there is a natural Markov measure associated to 9, which we denote SMPMoo . It 
is a primitive, stationary Markov chain with some transition matrix p. It can be 
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defined combinatorially (see ([T])) or as the unique invariant measure under the adic 
transformation (see Section [d]). 

For every x = {a,j),y = {b,k) G X, let SSIM;J, ,^ = 1 {a = 9{b)k} ■ We then 
define, inductively, 

SSIMI^ = ^ SSIMS7/ SSIM',^ . 


Hence, SSIM^ y counts the number of elements in started from x and ended 

at y. Let SSIMJ,^ . 

We can see that SSIM.^. is a primitive matrix: since 9 is primitive, there exists 
k such that for any c,d G A, c appears in 9^{d). This means that there exist 
mi,m 2 , ■ ■■,mk so that 9{9{- ■ ■ {9{d)mi)m2 = c. Thus for any (a,i), {b,j) G 

X,a = 9i--- i9ib),)rm • • • )m., so SSIM'j+i > 1. 


2.3. Eigenfunctions of SS1M7- We begin by observing that for all (a,j) G X 
and all b G A 


\m\ 

Ma,b = ^2 ■ 


fc=l 


Let {p{b))b be a right Perron-Frobenius eigenfunction of M with Perron-Frobenius 
eigenvalue A, and define the map p{(b,k)) = p{b) for all {b,k) G X. Then we have 
that for any (a,j) G X, 

•^/3(a,j) = Ap(a) 

= Y,M,Mb) 

b 

~ ^ P{b) 

(b,k)^X 

(b,k)^X 

Hence, as it is non-negative, p is a right Perron-Frobenius eigenfunction of SSIM^. 
with eigenvalue A; the same calculation shows that any right eigenfunction of M 
can be canonically associated to a right eigenfunction of SSIM^. . 

Conversely, a similar calculation shows that any left eigenfunction g of SSIM?^. 
gives rise to a left eigenfunction of M with the same eigenvalue by the formula 
<?(a) = provided that g is non-zero. Furthermore, by the eigenvector 
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equation we have 

Xgg{b,k)= 

{a,j)€X 

= Y = «} 

{a,j)€X 

= Y = a} 

a^A 

= g{0{b)k). 

Hence, if a is the left Perron-Frobenius eigenfunction of SSIM.^., normalized so 
that ®’(®) = bT{a,j) is the left Perron-Frobenius 

eigenfunction of M normalized so that = 1 br{b, k) = \~^a{9{b)k) 


2.4. Measures on path space. To prove our theorems, we must consider the 
measure ujv that arises on X*’P by choosing an integer n G {1,2,..., N} uniformly 
at random. This means that for every n G (1, 2,..., N} 

Ujvd^a.pHI) = 

where \0P-^ia)\ <N < |6»P(a)|. 

We will decompose ujv in terms of other measures. For every p G N and y G X 
define the probability measure UPMy^p for each x = xiX 2 ■ ■ ■ Xp G X*’P by 


UPM,,p({x}) 


Then the following is immediate. 


1 {xp = y} 

SSIMP 7 / ■ 


Proposition 2.1. Let a G A and p G N 6e such that |0^’“^(a)| < N < \0P{a)\. Let 
'^a,p{N) = (vi,ki){v2,k2) ■ ■ ■ (vpAp)- Then for every y. = xiX 2 ---Xp G X*'P, we 
have 

p SSTM^ 

UA,({x}) = j]] Y -^^^^UPM(„,jyX{a;ia;2---a;d). 

£=1 l<i<ki 


We can also write, for any x = X 1 X 2 ■ ■ ■ Xp G X^, that 


p-i 


UPMp p ({x}) = ^ TT SSIM{. . 

1—1 

This family of measures has a (inhomogeneous) Markov chain structure. To express 
this, define a collection hlf of Markov transition matrices given by, for all cc, z G A”, 


hl{x,z) := 


SSIM{_^ SSlMP-y^ 

SSIMS:/ ^ 
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which is a transition matrix as for any x,y G X and any p G N, 

^ ^ SSIMi^.SSIMP;/ ^ 

> h^(x,z)= > -^-i— 1 ^ = 1. 

^ SSIMr„^ 

z^pc z^pc 

This allows us to express UPM^^p for any x = X 1 X 2 • • • Xp G X^ as 
UPMp,p({x}) = 

^uv r ^ uv. 

X2)/l"_i(x2, X3) . . . feg(Xp-2,Xp-i) gg^j^p-i 1 {Xp = y} ■ ( 4 ) 

*iy ^p—itV 

By the Perron-Frobenius theorem, as SSIM^. is primitive, we have for all x,y G X 


Hence the limit 


lim A ^ SSlM^ y = a{y)p{x). 


p(x, z) = lim M{x, z) 

p—¥00 ^ 


( 5 ) 


exists for all x,z G X and is independent of y. In fact, there is a constant c > 0 so 
that for all p G N, 


sup |p(x,z) - hl{x,z)\ < e 


x,zGP(^ 


Further, we have the following explicit formula for p : 

SSIMi,,p(z) 


Piy,z) = 


A/5(2/) 


( 6 ) 


( 7 ) 


It also follows that the limit 


SSIM^-i 

rD(xi) = hm 


P(a^i) 


p^-SSIMP-i E.6A/5(^) 

exists. This motivates the definition of the following Markov measure on X*’P, 
where for any x = X 1 X 2 ■ ■ ■ Xp, 


p-i 


MPMp ({x}) = rD({xi}) p(xi,Xi+i). 


( 8 ) 


2=1 


We will also define a stationary version of MPMp . 

Let m be the invariant measure of p on A'. Define, for x = xiX 2 * * • Xp € 


p-i 


SMPMp ({x}) = m({xi}) p(xi, Xi+i). 


(9) 


i=l 


It follows that the invariant measure m must be Tn(y) = d'{y)p{y), as 


SSIMV/5(z) 

LI '3'(y)/3(2/)p(2/.2) = L-1“^-= o-(z)/3(z). 

1 / 6 A' j/SY 


A 
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Given a function f : A ^ C, define a probability measure n on ^ by the following 
formula 

f{a)n{da)= f Sf{9{a)<j)m{d{a,j))= ^ a{a,j)p{a,j)Sf{9{a)<j). (10) 

^ {a,j)€X 

This measure will be used to express the drift in the central limit theorems as well 
as the condition for being a coboundary. 



Example 2.1. Let A = {a, b} and 9 is given by 

9 ■. a ^ aab, b —>■ bba. 


Then the 9-matrix M is 

• Eigenvalues: A = 3, A/ = 1. 

• Left eigenvectors cr = [1,1], / = [1, — 1]. 

• Right Perron-Frobenius eigenvector p = ( ) ) • 

• The state space is denoted by X = {(a, 1), (a, 2), (a, 3), (6,1), (6, 2), (6, 3)}. 
Then SSIM.^. is given by 




/ 1 1 1 0 0 0 \ 

1110 0 0 
0 0 0 1 1 1 

0 0 0 1 1 1 

0 0 0 1 1 1 

V 1 1 1 0 0 0 / 


• A left and a right Perron-Frobenius eigenvectors a and p of SSIM)^ . are 


a = [ 1 / 6 , 1 / 6 , 1 / 6 , 1 / 6 , 1 / 6 , 1 / 6 ], ff = [ 1 , 1 , 1 , 1 , 1 , 1 ], 

• the invariant measure is iTi(y) = d'{y)p{y) = g for any y G X. 

• From ([7]), p = I SSIM]^^. . 

We have that 

f /(a)n(da) = V (T(a,/)p(a,j)5'/(6>(a)<j) = (0 + l + 2 + 0-l-2)i = 0. (11) 

(a.,)CY ® 


2.5. Reversed path space. When working with eigenfunctions with eigenvalue 
I A/1 > 1, it is more convenient to work with a reversed path space. Define the 
reversed path space Xf'^ C X^ as the reversals of all sequences in X*’P. Fix a G A 
and consider Xf'^ as embedded in X°° by appending to any element the infinite 
sequence (a, l)(a, 1) • • • . Make X°° into a topological space by endowing it with the 
product topology, and let Xf'°° be the closure of U^Xf’P. Now define iP)) : N —>■ X°° 

by 

^ q (^) = (vp, kp)(vp-i, kp-i) ■ ■ ■ (vi, ki)(aA)(aA) ■ ■ ■ , 
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where {vi,ki) are those appearing in '^a,p{N) for |0P“^(a)| < N < |0p(o)|. 

We will now give another description of UPMy^p, which is useful for reversed 
path space. Define a collection qp{y, z) of Markov transition matrices given by 


qpiy,z) 


ssimj-2 

SSIMP 7 / 


SSIMt 


which is a transition matrix as for any y G X and any p G N, 


^) = H 


SSIMP7/ SSIM^^y 
SSIMP 7 / 


= 1 . 


This allows us to express UPMy^p for any :x. = X 1 X 2 ■ ■ ■ Xp G X*’P as 

p-i 

UPMy pdx}) = qp—ij^\ , Xp—i) 1 \jj = Xp} . (1^) 

i=l 


As SSIM^. is a primitive matrix, by the Perron-Frobenius theorem, the limit 




lim qp{y,z) 

p—¥oo 


a{z) SSIM^ 
A<5-(j/) 


(13) 


exists for all y,z G X. We also have that there is a constant c > 0 so that for all 
p G N, 


sup \f{y,z) - qp{y,z)\<e (14) 

y,z(^X 


Let a be any probability measure on A, and define a Markov measure RMPMq 00 
on X*’°° by, for any cylinder set [x] = [xiX 2 ... Xp], 


p-i 

RMPMa,oo ([x]) = a(xi) p*(xi,Xj+i). (15) 

i=l 


3. Main results 

Let 0 be a primitive substitution and let u = (u„)((T]^ be any fixed point of 9. 
Denote the Perron-Frobenius eigenvalue of the 0-matrix by A. For eigenfunctions / 
of M with eigenvalue A/ having |A/| < 1, it is well known that the Birkhoff sums 
Sf{u<N) stay bounded. We show they also have distributional convergence to a 
bounded random variable. 

Theorem 3.1. Let f be a left eigenfunction of M with eigenvalue A/ with |A/| < 
1. Let Kn be a random variable with uniform distribution on {1,2,..., A^} . For 
x = {vi,ki){v 2 ,k 2 ) ■ ■ ■ G X*’°°, define lF/(x) = ^/~^'5'/(^'(D)<fci)- Then, 

Sf{u<K^) ^ Wf(X), 

where X has the distribution of MPMoo . 
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In the case that |A/| > 1, on the other hand, the Birkhoff sums will not in general 
have a distributional limit. In fact, there are many distributional limit points of 
Sf{u<KN)N~ a,s N ^ oo. We show that by choosing different subsequences, 

it is possible to get different distributional limits, although their distributions are 
closely related. 

Theorem 3.2. Let a = ui, and let f be a left eigenfunction of M with eigenvalue 
Xf having A > |A/| > 1. Let Ni be a sequence with Ni ^ oo so that 

VI/^(W) ^ Z = (pi, A^i)(p2, K2)---e 

Suppose p is normalized so that ~ Define a probability measure on X 

by 

1 °° 

a((u, k)) = —a{{v, k)) l{v = pq and k < k,} A^“'^, 

K ^ 

9=1 

where R > 0 is chosen so that a is a probability measure. 

Let be a random variable with uniform distribution on {1, 2, ..., W} ■ For 
X = {vi,ki){v 2 ,k 2 )--- e X*'°°, define Uf{x) = Let p = 

p{i) G N be such that |0i’“^(a)| < < |0i'(a)|. Then, 

Sf{u<KM^) ^ UffX) 

l-^/lgipWargA/ R^°ex 

where X has the distribution of RMPMo^oo ■ 

Remark 1. Alternatively Theorem 13.21 can be formulated as 

Sf{u<K^^) UfjX) 

^ A/T 

Remark 2. In both of Theorems 13.II and 13.21 the support of the limiting measure 
is a Cantor set. This can be seen by noting that Wf (and Uf) are continuous 
functions from X°° with the product topology, which is a Cantor set. 

We will soon formulate our main theorems when |A/| = I, but before doing so, 
we give a characterization of eigenfunction coboundaries. Recall that a continuous 
function / : A —>■ C is called a coboundary if there exists a continuous function g 
such that / = g — goT. By the Gottschalk-Hedlund theorem [^, if A is a compact 
metric space and T : A —>■ A is a minimal homeomorphism, and if / : A —>■ C is 
continuous, then / is a coboundary if and only if there exists K < oo such that 
\J2n=i f ^)\ — all A G N and x G X. Kornfeld and Lin [2] obtained 

a more general result: if A is a compact Hausdorff space, and T is an irreducible 
Markov operator on C'(A), then sup^ || / ° ^"11 < oo if and only if / is a 

coboundary. 

For left eigenfunctions / of M, we show a further characterization of cobound¬ 


aries. 
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Proposition 3.1. Let be a substitution dynamical system associated 

to a primitive substitution 9. Suppose that f is a left eigenfunction of M with 
eigenvalue A/ having |A/| = 1. Then the following are equivalent. 

(i) The function w i-A f(wi) from Xg C is a coboundary. 

(ii) There exists w € Xg such that sup^ |S'/(i(;<jv)| < oo. 

(Hi) There is a function h : A ^ C so that for all {a,j) G ^ 

/(c)n(dc) + h{a) - Xj^h{e{a)j). 

(iv) There is a function h : A ^ C so that the following hold. 

(a) For all {a,j) G X with 1 < j < |0(«)|, 


f{0ia)j) = Xj\h{9{a)j) - h{0{a)j+i)). 

(b) For all a € A., 

J f{c)n{dc) + h{a) — Xj^h{0{a)i)=O. 

Remark 3. Say that a function / : Al — >■ 5^ is a coboundary in the sense of Host 
(see m or [SI Definition 7 . 3 . 13 ]) if there is a function h : A ^ so that for 
all admissible 2-letter words ab, h{b) = h{a)f{a). If / satisfies condition (iv) of 
Proposition 13.11 then a i—>■ and a i—>■ are coboundaries in the sense of 

Host. 


For an eigenfunction f oi M which is not a coboundary with eigenvalue A/ having 
|A/| = 1, let Zf be the following normal random variable. 

(1) If Xf ^ R, then Zf is a complex normal variable. Further, Zf = X + iY, 

where X, Y are independent, centered normal distributions with = 

EF^, and letting g = f — J f dn, we have 

OO 

E\Zf\^ = E\g{X,)\^ + ^ 2EK[Aj-iff(Xi)^(^], 

k=2 

where (Xi, X 2 ,...) has the distribution of SMPMoo. By Proposition 13.11 
and Theorem llO.il this variance is 0 if and only if / is a cobouiidary. 

(2) If A/ S R and / is real, then we have that Zf is real and has the same 
variance as above. Again, the variance is 0 if and only if / is a cobouiidary. 

Theorem 3.3. Let f be a left eigenfunction of M with eigenvalue Xf with |A/| = 1 
so that f is not a coboundary. Let Kjq be a random variable with uniform distri¬ 
bution on {1, 2,..., N} . Then if Xf 1, as N ^ 00 

Sf{u<KN) ^ ^ 

y/log^{N) ^ 

If Xf = 1 then 

Sf{u<K!,) - logA(^) Ia ^ 
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The combination of Theorems 13.1113.21 and 13.31 allows us to give a new complete 
description of systems with bounded discrepancy (the first such description is due 
to El)- Say that a fixed point u has bounded discrepancy if for every a G A, with 

fa - given by fa{b) = 1 {a = 6} , 

sup |S'/„(u<Ar) - Nq ({a}) | < oo, 

NeN 

where q is the occurrence frequency of a, i.e. q{a) = limjv->.oo (a<n)- 

Corollary 3.1. Suppose that u is a fixed point of a primitive substitution 9. Then 
u has bounded discrepancy if and only if 

(1) All eigenvalues of M except the Perron-Frobenius eigenvalue have modulus 
less than or equal to 1. 

(2) The geometric multiplicity of each eigenvalue of modulus 1 equals its alge¬ 
braic multiplicity, i. e. each Jordan block in the Jordan form of M having 
eigenvalue of modulus 1 is 1-dimensional. 

(3) Each eigenfunction f with eigenvalue equal to 1 is a coboundary in the sense 
of Proposition \3.1\ 

Proof. Let W C {/ : / / dg = 0} be all those functions so that 

sup |S'/(M<Ar)| < oo. 
agn 

Note that this is a vector space. Hence u has bounded discrepancy if and only if 
dim W = |.4| —1, as the functions {fa — f fadq '. a G A} span the space {/ : J f dq = 0{ . 
Given a basis of generalized eigenfunctions /o, /i, / 2 , ■ ■ •, /r, with /o the Perron- 
Frobenius eigenfunction, we have that J fi dq = 0, {1 < i < r) and hence {/: J f dq = O} 
is also spanned by /i, / 2 ,..., /r ■ Hence the necessity of the first and third condi¬ 
tions follow by Theorems 13.21 and 13.31 For the second condition, suppose that A/ 
were an eigenvalue with |A/| = 1 so that in the Jordan form of M, there is a non¬ 
trivial Jordan block. Then by [1] Theorem 1], there are functions with unbounded 
discrepancy. Hence all three conditions are necessary. 

Conversely, suppose that all three conditions are satisfied. Then we can give a 
basis of generalized eigenfunctions /o, /i, /2 , • ■ ■, /r, where /o is the Perron Frobe¬ 
nius eigenfunction. For those that correspond to eigenvalue of modulus less than 
1, it is easily checked using the path space decomposition that these have bounded 
discrepancy. For those with modulus 1, we have that their Birkhoff sums remain 
bounded as they are eigenfunction coboundaries. □ 

3.1. Typical orbits. So far, we have focused on proving theorems for a fixed point 
u of 6. We now show how Theorem 13.31 changes when instead of looking at u, we 
look at other sequences v from the orbit closure of u (see Section |4] for the relevant 
background). 
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Theorem 3.4. Let {Xg,B, be the substitution dynamical system arising from 
the primitive substitution 9. Let f be a left eigenfunction of M with eigenvalue A/ 
with I A/1 = 1 which is not a coboundary. Let be a random variable with uniform 
distribution on {1, 2,, N} . Then for every v G Xg^ there is a seguence 
so that if Xf 1 

Sf{v<KN) - av,N ^ ^ 
yJ\Ogy,{N) ^ 

as N ^ oo and if Xf = 1, 

Sfiv<Ky,) - av,N - logA(^) Ia fiaMda) ^ ^ 

^yiogy^iN) ^ 

Further, for pL-almost every v, there is a constant C > 0 independent of v so that 

|ai,.Ar - logxiN) f{a)n{da)\ 

=== _ ^ , 

(16) 


lim sup ■ 
N—^OO 


Vlog N log log log N 


lim sup ■ 




= C forXf = l 
= C forXf^l. 


AT-S-OO Vlog N log log log N 

Hence the fixed point differs from typical orbits in that = 0, while all orbits 
of eigenfunctions of modulus 1 give central limit theorems. 

3.2. Examples. 


= {a, 6} and 0 i ,02 o.'n-d 9^ are given by 

: a —>■ aab, 

b —>■ bba. 

: a —>■ aab, 

b —>■ bab. 

: a —>■ aba, 

b —>■ bab. 


The 9i-matrix M is given by 


2 1 
1 2 


Then f = [1,-1] is a (left) eigenvector of M corresponding to the eigenvalue A/ = 1. 
Using the information obtained in the Examvle \2. 11 we see that 

(i) 9\: It has drift 0 from eguation dill) . Also f is not a coboundary, otherwise 

1 = f{9{a)i) = h{e{a)i) - h{9{a)2) = h{a) - h{a) = 0, 

which is impossible. So we have a central limit theorem. 

(ii) 02 • Similarly we see that f is not a coboundary. In this case we see a loga¬ 
rithmic drift since 

f /(a)n(da) = ^ (T(a, j)/5(a, j)<S'/(0(a)<j) = (0 + 1 + 2 + 0 - 1 + l)i = i. 

(aj)GA 

So we have a central limit theorem with non-zero drift. 
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(in) O 3 : A fixed point of this substitution is periodic: 

ababab■■■ . 

So there is no central limit theorem. 


Example 3.2 (Rational eigenvalues). Let A = {a, 6} and 6 is given by 

0 : a ^ abb, b —>■ baa. 

Then the 8 -matrix M is 

1 2 
2 1 

and eigenvalues and corresponding (left) eigenvectors of M are 
A = 3, a =[1,1], A/= -!,/= [1,-1], 

By a similar computation to part (i) of Examvle \ 3. 1[ we see that f is not a cobound¬ 
ary, so we have a CLT. 


Example 3.3 (Irrational eigenvalues). (Adapted from [HI Proposition 4.1]). Let 
A = {a, b, c, d} and for every n>l, On is given by 


= 


a ^ ad 
b —>■ adbbd 
c —>■ ad{hc)^^^bd 
d —>■ ad{bc)"'bd. 


Then the characteristic polynomial of the dn-matrix Mn has the roots Ai, A 2 , A 3 , A 4 
such that 


(i) A 4 = 1/Ai, A 3 = I/A 2 and Ai > IA 2 I = IA 3 I > A 4 . 

(ii) A 2 and A 3 are of modulus 1, so they are Salem numbers. 

(Hi) If X 2 = then a is irrational. 


In matrix theory, various authors have studied how to determine the d-tuples 
of complex numbers which can occur as the eigenvalues of a primitive matrix. 
Especially, Boyle and Handelman [S] formulated “Spectral Conjecture". Later Kim, 
Ormes and Roush m obtained the following result. 

For A = (Ai, A 2 , ..., Xd), denote 

d 

tr(A"') = ^(Ai)" and tr„(A) = f tr(A'^) 

i—1 k\n 

where p, is the Mobius function. 

Theorem 3.5. Let A = (Ai, A 2 , ..., Xd) be a d-tuple of nonzero complex numbers 
with I All < IA 2 I < ■■■ < I Adi- There exists a primitive integer matrix A such that 
det(/ — At) = nf=i(l ~ if and only if 
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(i) the polynomial Of=i(l ~ integer coefficients, 

(a) Ai > |Ai| for i = 2,3,... ,d 
(Hi) trn{A) > 0 for all n > 1. 

Note that for a matrix A, there is m > 0 such that det(t/ — A) = t™ 0^=1 {t~ ^i) 
if and only if det(/ — At) = nt=i(l ~ ^A)- 

Example 3.4 (Eigenfunction coboundaries). Let A = {a, b, c, d} and 6 is given by 
0 : a ^ ab, b ^ ca, c ^ cd, d —>■ ac. 

Then the 9-matrix M is 

/ 1 1 0 1 \ 

10 0 0 

0 111 

V 0 0 1 0 / 

Eigenvalues of M are 

Ai = 2, A 2 = —1, A 3 = 1, A 4 = 0 
and corresponding (left) eigenvectors of M are 

17= [ 1 , 1 , 1 , 1 ], [- 1 , 2 ,- 1 , 2 ], [- 1 , 0 , 1 , 0 ] [ 1 ,- 1 ,- 1 , 1 ], 

A right Perron-Frobenius eigenvector p is given by = [2/6,1/6, 2/6,1/6] so that 
^(T(a)p(a) = 1. Then we have that m has the form 

( 1 / 6 , 1 / 6 , 1 / 12 , 1 / 12 , 1 / 6 , 1 / 6 , 1 / 12 , 1 / 12 ) 

on the state space A = {{a, 1 ), (a, 2 ), (b, 1 ), (b, 2 ), (c, 1 ), (c, 2 ), (d, 1 ), (d, 2 )}. 

(i) A/ = 1 and f = [—1,0,1,0]. One has 

[ f{a)n{da) = 0 
JA 

and the function h : .4 —>■ R such that h{a) = h[d) = 0, h[b) = h{c) = 1 satisfy 
the condition (Hi) and (iv) in Provosition \3 . 11 so f is a coboundary. 

(a) Xf = —1, / = [—1, 2, —1, 2]. We can obtain 

J^f{a)n{da) = - i 

and it is not difficult to show that f is not a coboundary by checking condition 
(Hi) in Provosition \S.l\ 

Example 3.5 (Fibonacci substitution). The Fibonacci substitution 9 is given by 

9 : a ^ ab, b ^ a. 

The 9-matrix of the substitution is 


M = 


1 1 
1 0 
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Let a. = —Then M has eigenvalues Ai = 1 + a and A 2 = —a. 

Let u = (wn)^! = The sequence u also can he obtained by a 

rotation by a (c.f. [HI Proposition 5.4.9]j; 

Un = a, if {na} G [1 — a, 1) = & if {na} € [0,1 — a). 

Let f be a function such that f(a) = 0 — (1 — a) and f{b) = 1 — (1 — a). Then, for 
/ = [0,1 - a), 

n 

Zc{n; I) - n(l - a) = ^ f{uk) = Sf{u<n). 

k^l 

Moreover f = (—1 + a, a) is an eigenvector corresponding to the eigenvalue A 2 = 
—a, so IA 2 I < 1. For Beck’s case, if I = [0,a:) for x G Q, then we have a central 
limit theorem for Za{n; I) — n(l — a). From Theorem \3.1[ when x = 1 — a, the 
limiting distribution of Za(n; L) — n(l — a) is supported on a Cantor set and has a 
different normalization than when a; G Q. 

4. Substitution dynamical systems 

Let ^ be a finite set of letters, endowed with the discrete topology, and let 
have the product topology, so that is a compact metric space and the shift map 
T given by {Tu)n = Un+i is a homeomorphism. The pair {Jl?‘,T) is called the full 
shift on the alphabet A. If X is a closed T-invariant subset of the pair {X,T) 
is called a subshift. 

Given x G A?", let L{x) be the set of all finite words appearing in x. The language 
of 0, denoted by Lg, is the set of all finite words occurring in 0"(a) for some n > 0 
and a G A. Let Xg = {x G A^ : L{x) C L{0)}. Then Xg is closed in A^ and 
invariant under the shift. We denote by T the restriction of the shift to Xg. The 
pair {Xg,T) is called the (two-sided) substitution subshift associated to 9. It is 
known that {Xg,T) is minimal and uniquely ergodic (see |8] or mi). 

Remark 4. For a given substitution 9, there exist two letters a,b G A and k G N 
such that 

• a is the last word of 9^{a), 

• b is the first word of 9^(b), 

• ab G L[9). 

Then there exists v G A^ such that u_i = a,vo = b and 9^{v) = v. We say that v 
is a (two-sided) fixed point of 9. In this case we have Xg = {T"u : n G Z}. 

Remark 5. We also can define the one-sided substitution subshift associated to 9 
by the following. By the construction above, there is a fixed point u for 9. Let 
Xg be the orbit closure {T"u : n G No} (where No = N U {0}). The pair (Xg, T) is 
the substitution subshift. This definition can be checked to be independent of the 
choice of fixed point u. The projection tt : A^ —^ maps Xg onto Xg and (X, T, tt) 
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is the natural extension of (Xs,T), that is, for every dynamical system S') and 
every factor map (j) : Y ^ Xg there exists a unique factor map ip : Y ^ Xg with 

TT O p) = (p. 

4.1. Desubstitution. Let 0 be a primitive substitution with non-periodic fixed 
point. The result on recognizability by Mosse allows one to desubstitute w in Xg 
(c.f. [S] for details): 

W = ■■■ W-m ■ ■ ■ W-iWqWi ■ ■ - Wn - ■ ■ = ■ ■ ■ 0(l/_ 1 )0(l/o)^'(2/l ) ' ' ' , 

where wq lies in 0{yo). 

Thus, for a point w G Xg^ there exists a unique sequence {pi, Ci, Si)iGNo ^ ^ 

A X ^*)^‘> such that 0(ci+i) = PiCiSi and 

w = ■■■ 9'^ {p2)9{pi)po-coso0{si)9'^ ( 32 ) ■ ■ ■ 

which is called a prefix-suffix decomposition of w. If only finitely many Si are 
non-empty, then there exist a G A and Z, s G N such that 

a;[o,oo) = coSo 6 '(si) 0 ^(s 2 ) • • ■ 0 ^(s;) lim 0 "®(a). 

n^oo 

Similarly, if only finitely many pi are non-empty, then there exist h G A and m,t GN 
such that 

X(_oo- 1 ] = lim 9^*{b)9^{pm) ■ ■ ■9{pi)po- 

4 . 2 . Adic transformations. As p —>■ oo, MPMp induces the Markov measure 

MPMoo on the infinite path space Following Livshits [16], we define the adic 

transformation Ta on X*’°° as following: given x = {vi,ki)iv 2 ,k 2 )iv 3 ,k 3 )''' S 

• if fci < |0(U2)|, 

Ta(x) = {vi,ki + 1)(W2, k2){v3, fca) • • ■ 

• otherwise, let £ be the smallest positive integer such that ke < \9{vi+i)\, 
then 

TA{y£) = {hi, l){b2, 1) ■ ■ ■ {be-i, l){be, h + l){vi+i, ki+i){vi+2A(.+2) ■ ■ ■ 

where h^ = 9{vi+i)j^+i and bi = 9{bi+i)i for 1 < f < £ — 1. 

It is known that the adic transformation is uniquely ergodic and it is measurably 
isomorphic to the substitution subshift. 

Consider the set C of the form 

C — [(^1: ^l) ■ ‘ ‘ (Xyn 1 ^m)] \ [(^1; ^l) ‘ ’ ' (Pm— 1 1 km—l) {'^m j |^(Xm) | ) (^m+1 j )] 

(17) 

Then for large N, vn{C) = vn{Ta{C)). Since the sets of the form (flTll generate the 
Borel cr-algebra on MPMoo, by Proposition 15..'ll below. Ta is invariant with respect 
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to MPMoo. Then MPMoo, Ta) is measurably isomorphic to the substitution 

subshift {Xe,fi,T). 

Also, as p —>■ 00 , SMPMp induces the stationary Markov measure SMPMoo 
on the infinite path space X*’°° with the invariant measure m given by m(y) = 
o{y)p{y) and the transition probability given by p{y,z) = where A is 

the Perron-Frobenius eigenvalue of SSIM.^. and a and p are corresponding left and 
right eigenvectors with '^y^{y)p{y) = 1- It is known [T^ that SMPMoo is the 
maximal measure for the topological Markov shift on X*'°°. 

5. Comparing measures on path space 
R ecall that for x = xiX 2 ■ ■ ■ Xp G 

p-i 

MPMp ({x}) = rD({a:i}) >p{xi,Xi+i). 

i=l 

We will show both of UPMj, p and MPMp are very similar for large p. To compare 
them, we recall the notion of total variation distance. For two measures p and u 
on a common measure space (X, 17), the total variation distance (Itv is given by 

drvip, = sup \p{A) - u(A)|. 

Aen 

The following is now an exercise in coupling (see nn Chapter 4,5] for an introduc¬ 
tion): 

Proposition 5.1. For any r < p G N, let —>■ X*’P~'^ be given by 

S'"{XiX 2 ■ ■ ■ Xp) = X1X2 ■ ■ ■ Xp-r- 

For every ci > 0 there is a constant C2 > 0 such that for all p G N, all y G X and 
all integers r > C 2 logp, 

dTu(MPMp oS^, UPMp,p 05”') < . 


Proof. We begin by defining coupling of two probability measures on a common 
probability space. Suppose that ui and U2 are probability measures on a probability 
space A coupling of vi and 1^2 is a probability measure 7 on the product 

space {X X X,B®B) such that marginals are vi and z/2- The total variation norm 
of vi and V 2 can be expressed in terms of couplings of vi and 1^2 ■ Specifically by 
nsi Proposition 4.7], 

dTv{vi,V 2 ) = inf 'y{{x, z) G X X X : X ^ z}. 

7: couplings 

To bound for total variation norm of MPMpo5’' and UPMj, po5’', it suffices to 
construct a coupling 7 such that 7{(x,2/) G X*’^ x X*’P : x ^ y} < We recall 



20 


ELLIOT PAQUETTE AND YOUNGHWAN SON 


for convenience (j4l), which states that for yi = xiX 2 ■ ■ ■ Xp, 


UPM,,p({x}) = 

p.i hl[xi,X2)hl_^{x2,X:i) ... h"(a 


SSIMl 


For a fixed x G X, h^(x,-) and p(a;, •) are probability measures. For any pair 
{x, z) G X"^ and any 2 < k < p, we define a coupling Gk{{x, z), (•, •)) of h^{x, ■) and 
p(z, •) such that Gk{{x,z), {■,■)) attains dTv{h\{x,-),p{z,-)). This coupling can in 
fact be given explicitly, see m Remark 4.8]. We also let G 2 {{x,z), {■,■)) be any 
coupling of Sy and p(z, •), and we let Hp be the coupling that attains the total 
variation distance of the measures 


SSIMP-i 

SSIMj-i 


and tod'}). 


Hence by Perron-Frobenius theory, we have 


Hp{x z) < e 


Now we define the coupling 7 on X*’'p x X*'^: 

p-i 

7(x, z) = Hp(^(x\, zi)) Gp—i^i{{xi, Zi), , z^+i)), 

so that 7 is the law of a Markov chain on X*’^ x X*'^. 

For any measures pi , /i2 on a countable space X, we have by [m Proposition 
4.2] that d-TvitJ-i, fJ-2) = ^ J2x&x \k-iix) - fJ-2ix)\. Hence for all fc < p, by (HI, 

Then 


7 (3j < P - T : Xj ^ Zj) 
p—r 

— 'y ^ 7{^t ^ j)) 

i=i 

p—r 

< 7(xi ^ zi)+'y2 7(a;j ¥= Zj\xj-i = Zj-i) 

i=2 

p—r 

< Hp{xi ^ zi)+'^ sup drvipix, ■), hp-j+ 2 {x, •)) 


Taking r = Glogp for sufficiently large C completes the proof. □ 

We can also compare SMPMp and MPMp in a similar way, which is a standard 
result on primitive Markov chains. 
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Proposition 5.2. For any r < p G N, let L'' : X*’P —^ X*’P ’’ be given by 
L (312^2 ■ ■ • ^p) — ^TT-\-‘2 • • * 3^p■ 

For every ci > 0 there is a constant C2 > 0 such that for all p G N and all integers 
r > C 2 logp, 

dTv{MPMpoL'',SMPMpoL^) < p-^K 


For a proof, see [TSl (5.2)]. 

As a consequence of Proposition 15.11 and Proposition 12.11 we have that 

Proposition 5.3. For every ci > 0, there is a constant C 2 > 0 so that for allp G N, 
a G A, N G N with |0P“^(a)| < N < |0^’(a)|, and all integers r > C 2 logp, 

(iTu(MPMp oS"-, i/jv o 5"') < 


Proof. By Proposition 12.11 


P SSIMS,, , , ,,, 


i—1 


We also have that 


V-^ SSIM^ (y A\ 

MPMpoS"- = ^ MPMp oS'^ 


e=i i<j<ki 


N 


Note that by stationarity, MPMp oS''’ = MPMp_j.. 

For any event A and large r as in the Proposition 15.11 let ro = [r'/2] 

luN o S"'(A) - MPMp oS"'(A)| 


E 


SSIM 




t=l l<j<ke 
P 


N 


< 


p _ SSTM* 

C—p—ro l<j<k^ 

\0P-^°ia)\ 


N 


{p-roY 


where we have applied Proposition 15.II to the third line. Then, for some a > 0, 

N |A’'»-‘| 

Picking C2 sufficiently large, the result follows. 


□ 
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6. Proofs for |A/| = 1 


Theorem [331 will follow immediately from Proposition [SII] combined with Propo- 
sition lSm However, Proposition [33] relies on Proposition 16.11 so we present Propo¬ 
sition |6T] first. 

Proposition 6.1. Suppose that f is a left eigenfunction of M with eigenvalue A/ 
with I A/1 = 1 for which there is no function h : A ^ C so that for all c G A 


Sf{0{c)<j)= / f{b)n{db) + h{c)-X^^h{e{c)j). 


Let Km be a random variable with uniform distribution on {1, 2,..., A^} , and let 
a G A be fixed. Then if Xf ^ 1, as N ^ oo 



If Xf = 1, as N ^ oo 



Proof. Given N, one can find pn such that ^(a)| < N < |0^’"(a)|. Now 


we define a function / on T” by f{vi,ki) = ^Then we have for any 
1 < K < N, that 


A/5/(0^(a)<ic) = ^A}/((u„fc,)), 


where "i'a,i{K) = {viAi){'i’ 2 ,k 2 ) ■ ■ - {viAi)- For m > pn, we have that km = 1. 


Hence /(um, km) = 0 for all these m, and we have 


PN 


XfSf{6^{a)^K) = Y.X)f{{vuh)), 



•\/logx N 


sired central limit theorems follow immediately from this. 


Let Z = ^ ^ Sr=i '^/(/((^u ^i))~J fdm), which is a function on X*’^. Then 


we have that 


XfSf{e^ia)^K)-E^:,X}Jfdm 

\/l 0 gA(^) 


Z{^a,pN{K)). 
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By definition of vn, we therefore have that for any bounded Lipschitz function 

N 


1 

N 


^ A-- 


K^l 


= E(l,{Z{M>a.pAKN))) 

(j){Z{x))iyN{dx). 


IX-'P 


We will show that for any bounded Lipschitz function cj) 


(/)(Z(x))ujv(dx) 


(j){x)^{dx), 


IX*’P 


where $ is the probability measure given by $(A) = F[Zf G A]. 
Let r = [(logpAf)^] and write Z = X + Y, where 


PN-r 


Y = 


^logA ^ ii 


^ A}(/((wi,fci)) - f /dm). 

^r+1 


Hence ||X|U « 

j (l){Z)dvN = J 4>{Y)di/N + J 4>iZ) - 4)(Y)dvN. 

As (p is Lipschitz, the second integral is at most ||0||Lip||-A||oo = o(l). Hence 


J (j){Z)dvN = J (j){Y o o L^)d(vM o o L^) + o{l) 

= J (piY o o L^)dSMPMp^ oS^oL^ 

+ 0{dTv{vN oS^o U, SMPMp^ 05 ”' o U)) + o(l). 

By Proposition [5T31 and Proposition 15.21 dTv{i^N o 5’' o L’’, SMPMp^ o5'’ o U") —>• 0 
as N ^ oo. Therefore 

J (j){Z)dvN = J (j){Y o o L^)dSMPMpj^-2r+o{l). 

Again using that X is uniformly small and the Lipschitzness of (p, we conclude 

J p{Z)dvM = J p{Z)d SMPMp^ +o(l). 

All said, we have shown that 

dBL (uAT o Z-\SMPMp^ oZ-i) ^ 0, 


as N ^ oo uniformly in £. 
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Now the theorem follows from Theorem 110.11 and the observation that t 

1, provided that we show that there is no h satisfying P*Ph = h so that / = 
f f(x)m(dx) + h — XfPh, where p* and p are defined in (IT^ and (O and 

iPh){x) = Y,p{x ,y)h{y) and {P*h){x) = ^ p*{x,y)h{y). 

Suppose that there were such an h. Then by Theorem llO.!) we have that 

PN 

w = '£^‘f 

i=l 

is uniformly bounded in N for SMPMpj^-almost every path. As SMPMp has full 
support on for every p, we have that there is a C so that 


- / fdm] . 


sup sup \W {{vi,ki)^^^)\ < C. 
Hence we also have that 


sup sup 

N>0 (vi,ki)iPieX*'PN 


•, -pN-1 


wiiv.,hr,z,: 


< c. 


Observe that 

PN . 

= / fdm). 

i=l 

Hence by Theorem 110.11 applied to the reversed chain with transition matrix p*, 
there must be an h so that PP*h = h and / = / fdm + h — Xj^P*h. 

We now turn to characterizing those h for which PP*h = h. First, we evaluate 
PP* : by equations ([131) and © 


PP* iia,j),{b,k)) = y] p{{a,j),{c,e))p* {{c,i),{b,k)) 

{c,e)ex 

_ •ST' 1 {0ic)i = g} /5(c, £) 1 {0ic)i = b} d{b, k) 

Observe that this is nonzero if and only if a = 6. Hence pp* is a block matrix, with 
|Al| many blocks, each of which is positive. Moreover, we have that pp* is right 
stochastic, as it is the product of two right stochastic matrices, and hence 

|e(a)| 

1= pp* ((“0')> (^*)) = X! pp* • 

{b,k)£X fe=l 

Thus each of these blocks is itself right stochastic. As a consequence, the eigenspace 
of pp* with eigenvalue 1 has dimension |Al| and is spanned by those functions 
{a,j) h{a), where h : M —>■ C is any function. 
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Hence we have that h{a,j) = h{a) for some function h. Evaluating P*h, we have 
P*h{a,j)= 

(b,k)£X 


(b,k)eX 


Xa{a,j) 

1 {0(a)j = b} a(b, k) 


= h(0{a)j) ^ p* ((a,j),(b,k)) 

(b,fc)GY 

= H0(a)j). 


Therefore, we have that 

f(aJ) = J f(x)m{dx)+h(a) - Xj^h{0(a)j), 

which contradicts the hypothesis on / that we assumed in the statement of the 
proposition. □ 


7. Proof of coboundary proposition 


Proof of Provosition \3. 11 (i) (ii) : This follows from that (Xg, T) is minimal. 
(in) (iv) : This follows from the identities f{9(a)j) = S f (9(a) — S f (9(a) ^j) 

and Sf(9(a)^i) = 0. 

(i) => (in) : By Proposition 16.11 if (Hi) does not hold, then for a fixed point 

u = uiU 2 ■ • ■, limsup |S'/(u<Ar)| = oo. 

N—¥oo 

(Hi) => (ii) : Let u be a fixed point. Then by for each N there exists 
(vi,ki), fcp;v) & X so that 

PN 

Then, since Vi = 9(vi+i)ki+i, 


PN 

Sf(u<N) = ^ 
2=1 



f(c)n(dc) + h(vi) - Xj^h(9(vi)ki) 


= E 

i=l 

If A/ 7^ 1, then we are done. If A/ = 1, one can find a & A and fc S N so that 
9^(a)i = a. Then for 0 < i < /c — 1, 


f(c)n(dc) 


- Xj:^h(9(Vl)k^) + X^j:^ ^h(vp^). 


[ f(c) n(dc) + h(9"(a)i) - h(6»*+^(a)i) = 0. 
JA 


Adding these sums, we have J f(x)n(dx) = 0. Thus Sf(u<f.[) is bounded. 


□ 
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8. Proof of Theorem 13.41 


Let u{a,k) = 9^{a) for a S .4 and k,N S N. For n < \u(a,k)\, define 


Z^ia,k) = 


Sf{u{a, k)<n) - log^{N) f(b)n(db), if A/ = 1 
Sf{u{a,k)<n), otherwise. 


Lemma 8.1. Let f be a left eigenfunction of M with eigenvalue A/ having |A/| = 1 
which is not a coboundary. For any Borel measurable set A G C (^or R in the case 
Xf and f are real) let $(4.) = P(.Z^/ S A). For any Borel-measurable set A G C 
with $(9A) = 0, 


max 

aSA 

k£N:\u(a,k)\>N 


4|{1 <k<N-. G A}\- $(A) 


0 as N ^ oo. 


Proof. As A is finite, this follows directly from Proposition l6.ll 

Let M = |u(a, fc)|. For n < M, define 

-Sfiuia, k)[M-n+i,M]) - ^ogx{N) f(b)n(db), if A/ = 1 
-Sf(u(a,k)[M-n+i,M])’ otherwise. 

Lemma 8.2. For any Borel-measurable set A C C with $(9A) =0, as N ^ oo 


□ 


yuia,k) = 


max 

oGA 

fcGN:|u(a.fc)|>A 


1 in nr Zff{a,k) ,-,1 1 in AT 

( 18 ) 


Proof. Let M = |0^(a)|. Note that 

-Sf{u{a, fc)[M-n+i,M]) = -Sf{u{a, k)) + Sf{u{a, fc)[i_M-n]) 
= -A//(a) + Sf{u{a, fc)[i,M-n])- 

Then 


{l<k<M : G A} = {1 < A: < M : G A- 


A^/(c 


= } 


V^ogx M \/logA M x/logx M 

Thus, (1181) holds along the subsequence Nk = |0^(a)| t oo. Given a substitution 6, 
we can define a reverse substitution 9 by 9(a) = a„a„_i • • • oi for 9{a) = 0102 • • • a„. 
Since (fTSl) holds along the subsequence N^, if there exists a central limit theorem 
with a drift for 9 with eigenfunction / and there exists a central limit theorem 
for 9 and —/, then one has the same drift for 9 and —/. Now we can see that 
—Sf{u{a., k)[M-n+i,M]) is a Birkhoff sum of —/ on the substitution system associ¬ 
ated to 9. By Lemma ISTTl for some $1 and $ 2 , 


max 

a£A 

kGN‘.\u{a,k)\>N 


—1{1 <k<N : G A}| - d>i(A) 


^ 0 . 
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max 

tiG-A 

k£n-.\u{a,k)\>N 


1 Y^(n t'l 

N y^log;^ N 


0 . 


Since (ITS)) holds along the subsequence Nk = \0^{a)\ f oo, d*! = ^ 2 , so the proof is 
completed. □ 


Proof of Theorem \3.4\ We will prove for the case A/ = 1. The proof for A/ 1 is 
analogous. Let us consider prefix-suffix decomposition of v: 

V = --- 9'^{p2)d{pi)po-coSoO{si)e'^{s2) ■ ■ ■ (19) 


Case I. If only finitely many Si are non-empty, then for some a £ A and Z, fc G N, 
^[o.oo) = cqSqO^si) ■ ■ ■ 9^{si)u and u = lim„_>oo For sufficiently large n, 

Sf{v<n) = Sf{u<n) + 0(1). Thus the result follows from Theorem 13.31 
Case II. Otherwise, define Ni = |coSod(si) • • • d*(si)|. Note that Ni f 00 . For any 
positive integer N, we choose Ni such that Ni < N < Ni+i. Then set = 
5 '/(^^[i,W£])- Note that 




1 + Sf{v(^Ne,n])^ if n > Ni. 


Then 

1 

N 


{l<n<N ■ ~ ~ logA(^) Ia ^ 


N Ni 


\/l0gA N 

{l<n<Nr- ~ Xa ^ 


( 20 ) 


N -Ni 1 
N N -Nt 


\/logA N 

\/logA N 


Fix e > 0 small so that if M satisfies that eN < M < N, then ^ =1-1- 0(e) 
and log^^ = l-hO(e). 

For any N we have the following three cases: 

Case (i): eN < Ni < N and eN < N — Ni < N. If is large enough so that Ni 
is large, 


-SfiV(n,Ni]) - fogxjN) U fjbHdb) 

v^og^ N 

^ -Sf{v{n,N^]) - iogxjNi) J^f{b)n{db) 

\/l0gA Ni 


(1 -I- 0(e)) -I- ojv(l). 


So, from Lemma I5T^ 


1 

Y 


{1 < n < W : 


-Sf{v(u,N,]) - logA(^) Ia fi^Mdb) ^ ^ 

\/l0gA ^ 
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is as close as to $(A) for small e and large N. Similarly, 

N/EgUV 

is also as close as to $(^4). Thus ((20)l is close to 4>(A). 
Case (ii) Ni < eN. Then 


1 

N-Ni 


N Ni 


\l<n<Ni: -^Mn,Ne]) -^ogxiN) lAfjbHdb) ^ 

N 


< e. 


Also TV — > (1 — e)N > eN. Using the same argument as in Case (i), one can 

see that (l20l) is close to $(A). 

Case (iii) N — N^ < eN. It is similar to Case (ii). 

Now it remains to show equation m- For almost every v, the prefix-suffix 
decomposition (fTOl) satisfies Case II above, thus is given by Qv^n = ^f{'>^[i,Ne]) 
as above. Moreover we claim that there exists Cq such that for almost every v, 

log 

limsup—^ < Cq. (21) 

e^oc, logA« 


Note that for some t > 0, there exists c > 0, denoting m = t/c G N, such that 
if log^ > t, then Si-m+i, ■ ■ ■ ,si are empty-word. Since the sequences 

{Pi,Ci,Si)i^fig are primitive homogeneous Markov chains, for some a > 0, 


‘“S* TvT ^ ‘ 


< e 


Choosing t ^ log£ and applying Borel-Cantelli Lemma, the claim follows. 
Now we see that 


* 5 /( uia .]) = Sfico) + Sfiso) + XfSfis,) + • • • + XjSfisi). 


As S is an additive functional of the finite state Markov chain (pi, Ci, Si)igNp, 

the law of iterated logarithm holds (see Theorem llO.il) . If A/ = 1, this implies there 
is some C > 0 


|S'/(z;[i,ArJ-€/_4/(a)n(da)| 

hm sup-- - - 

£-^oo log log f! 


= c. 


From cm, the desired conclusion holds. For general A/ with |A/| = 1, a similar 
argument completes the proof. 

□ 


9. Proofs for |A/| ^ 1 
We begin with the proof of Theorem 13.11 
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Proof of Theorem \S.l[ Given iV, one can find pN such that |6*^"“^(a)| < N < 

\9P’^{a)\. We again define a function / on df by f{vi,ki) = Sf{0{vi)cki)- Then we 
again have that for any 1 < K < N, that 

PN 

XfSf{u<K) = 

where = (ui, fci)(u 2 , ^ 2 ) • ■ • {vp^,kp^). 

For any natural number p, let Zp = which is a function on 

We naturally embed as the initial coordinates of , and thus also 
consider Zp a function on . Also let Z^o = Wf = '^//((^u ki)), a function 

on Observe that 

sup sup |Zp(x)| < 00 . 

p>l xGY*-” 

Moreover, we have that uniformly in p, for all n > p we have that 

sup \Zp{-x) - Z^(x)| <C |A/|^. (22) 

Hence the same estimate holds for the difference of Zp and Z^o- 

We will show that for any bounded uniformly continuous function (j) 

[ 0(Zp^(x))uAr(dx) [ (/)(Zoo(x))MPMoo(dx), 

Jx‘'P Jc 

which will complete the proof. Exactly as in the proof of Proposition 16.11 using 
and Proposition 15.31 we have that 

J (j){Zp^)di>N = J (l}{Zp^)dMPMp^+o{l) = J (/)(Zp„)dMPMoo+ 0 ( 1 ) 

But by uniform continuity of (j) and (1221) . we have that 

J (j){Zp^)dMPMoa = j (/i(Zoo)dMPMoo+ 0 ( 1 ), 

so the proof is complete. 

□ 

Proof of Theorem \S.S\. Let p = p(£) G N be such that |0^’“^(a)| < W < |^^(a)|- For 
every x = a;ia ;2 • • ■ a^p G X*’^^ we have by Proposition 12.11 that 

p SSIM^”'^’*’^ 

t'Ne ({x}) =J2 UPM(„^ j),p_g+i ({a:ia ;2 • • • Xp-q }), (23) 

q=l l<j<kg ^ 

(Caution: we have used the reversed path here), where di)((W) = ki{£)){v 2 {(), k 2 {i)) ■ ■ ■ ■ 

We will begin by showing that as a measure on X°°, converges. Let be 
a measure on X°° given by the property that for any 1 < AT < Ni, = 

k'Ne{'i’a,p{K)). It follows that for any cylinder [x] = [xia :2 ■ ■ - Xp] 

UAf([x]) = VNiiXpXp-i . ..Xi). 


(24) 
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We will show that RMPMa^oo, which is equivalent to showing that for 

any fixed cylinder [x] = lxiX 2 ■ ■ ■ Xk] 

UN,([x]) ^ RMPM„,oo([x]). (25) 

Recall by ([5]) 


lim A ^ SSIM^ = a{y)p{x). 

p—^oo 


Moreover, we have that 


X-PSSlMl^ = a{v)p{x)+0{e-‘^Pl 


uniformly in x and y by Perron-Frobenius theory and ([5]). 

By the convergence of we therefore have that for every r G N, there is 

an £o{r) sufficiently large so that for all £ > io 


r kg(£)-l r 

E E —^^^ = E E + 

q=l j=l q=l l<j<Kg 


where we have used that 1 = Pi^)- Furthermore, we have that 

m '=‘.^-1 ssim ^ a ^+ E -) 

E E - *j£^ = 0iX-^), 

q—r-\-l j—^ 

uniformly in Ng. By (1^51) . we have that 


XP 


and hence 


Ne 

XpW 


w = E E 

9=1 l<j<kg 


= E E HiPq,m^-'^ + oie-^^^^^ + x-n, 


9 = 1 l<j<Kg 

uniformly in r for all £ > £o(j’)- Define 

Ne 




1-9 


9=11<1<K, 


(26) 


Then a))?;, k)) is given by 


CXJ 

a((v, k)) = ^)) = Pq and k < Kq} 

<7^1 

and from (I^Sl) and (E51) . (1^51) follows. 

Recall that Uf{x) = X]^i A/*5'/(0(i;i)<fcJ. This is a bounded C-valued con¬ 
tinuous function from X*’°° under the product topology. Hence for any bounded 
uniformly continuous function 0 : C —>■ M, by the definition of RMPMa^oo, 

we have that 

lim / (/)([//(x))i>iv,(dx) = [ (j){Uf{x))RMPMa,oo{dx) 
i^ooj J 
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The remainder of the proof now proceeds in the same maimer as the proof of 
Theorem 13.11 with some minor changes. We define a function f on X hy f{vi,ki) = 
Then we have for any 1 < K < Ni, 

p(£) 

where = (m, fci)(f 2 , ^ 2 ) • • ■ ■ 

For any natural number p, let Up = ^i))) which is a function on 

Then we have that 


sup \Up{x)-Uf{x)\ Xf^. (27) 

xeY*.“ 

Then we have that for any bounded uniformly continuous 

Sf{u<K,^^))) = j ^(C/p(^)(x))uAr,(dx) 

= J ^(C//(x))uAr,(dx) +0(1). 


Hence we have shown that Sf^UcK^i) Uf{x.), with x distributed according 

to RMPMa,oo • As 

WogAp/l ;^p(£)logJA^| 






it follows that 


Sfiu<Kf,,) 


|Aj|pW Sf{ucKffJ 


_^logA P/ I ^ip(e) arg \j ]v'°Sa A/ I I I 




and the proof is complete. 


□ 


10. Appendix: CLT 

In this section, we give a proof of the exact version of the Markov chain central 
limit theorem that we will need. Let Xi , X 2 , ■ ■ ■ be a primitive Markov chain on a 
finite state space X with invariant measure tt. Let P denote the probability measure 
of this Markov chain on Let p{x,y) be the transition matrix of the Markov 
chain, i.e.p{x,y) = P(A 2 = y\Xi = x). Hence, p{x,y) is a right stochastic matrix, 
and TT, its invariant measure, is the positive left Perron-Frobenius eigenvector of p 
whose II • 111 norm is 1. 

We also define the reversed transition matrix p* given by p*{x,y) = 
which is also a right stochastic matrix. It is easily checked that if Yj = Xn-j+i 
for j = l,2,...,n, then {Yj)j^^ are n steps of a stationary Markov chain with 
transition matrix p*. Further, p* is the Hilbert space adjoint of p with respect to 
the inner product on given by {f,g)^ = f{x)g{x)TT{x). 
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We also define the operators P and P* on by {Ph){x) — '^^^xP{x,y)h{y) 
and {P*h){x) = J2x&xP*i^^y)^iy)- Let = a{Xi, X 2 , ■ ■ ■, Xn), the cr-algebra 
generated by the first N states of the Markov chain. Then we have that for any 
iV G N, (Ph)(Xjv) = miXN+iWN). 


Theorem 10.1. Let / : T —>■ C and A G C with |A| = 1. Then either 

(1) If there is a function h : T —>■ C satisfying P* Ph = h and f = J f dn + h — 
XPh then we have 

sup 
NeN 

almost surely. 

(2) Otherwise, if there is no such function, we have that 

where Z has a complex normal distribution with E|Zp >0. //A G R and 
/ : T —>■ R, then Z is a real normal distribution. // A ^ R, then real and 
imaginary parts of Z are independent and have identical variance. Further, 
we always have that 

00 

E|Z|2 = E|g(Xi)|2 + ^ 2EK[A''-ig(Xi)^(^], 

k^2 

where g{x) = f{x) — J f dn. Finally, we have that there is a constant C > 0 
so that with probability 1 


N 

E 


A*(/(W) - I fdr. 


<2||h||c 


lim sup 

N—^OO 


j:liX{f{X,)-Jfd7r) 

\JN log log N 


= C. 


Proof. We will use the martingale central limit theorem to prove the convergence 
(see uni Theorem 3.2]). To do so, we will show that Yat = X'g{Xi) is nearly 
a martingale. The first step towards doing so is to show that there is a function 
h(x) so that g(x) = h{x) — \{Ph){x). Because p is a primitive stochastic matrix, it 
has Perron-Frobenius eigenvalue 1, and its other eigenvalues have modulus strictly 
less than 1. Hence, if A 7 ^ 1, then I — XP is invertible, so one can find a unique 
h{x). If A = 1, then the space W of r{x) with f r(x)7r(dx) = 0 is Q(I — P) since 

(i) W has dimension \X\ — 1, 

(ii) 3(1 — P) has dimension \X\ — 1 by considering eigenvalues of p, 

(iii) 3(1 -P)CW: 


h{x)Tr{dx) - / {Ph){x)TT{dx) = Eh{Xi) - E(E(h(X2)|.^i)) = 0. 
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Note that the kernel of / — P is just the constant functions, and hence we may 
choose h{x) to have J h dn = 0. Having made this choice, h is uniquely determined. 
Notice that in the case that A ^ 1, we have that h satisfies this condition as well. 
Let Zn = X^+^[h{X,+i) - {Ph){Xi)]. Note that 

Yn=Zn + \h{Xi) - X^+\Ph){XN). 

Also we can see that Zn is a martingale: 

E{Zn+i\^n) = Zn + X^+^E{h{XN+i) - {Ph){XNWN) = Zn- 

Furthermore, 

N-l 

E|Z^|2 = ^ E\h{X,+i) - {Ph){X,)\^ = {N- l)E|h(A 2 ) - (Ph)(Ai)|2 

i=l 

by the orthogonality of martingale increments. We now show that this variance is 
0 if and only if the function h satisfies P*Ph = h. If the variance is 0, then we 
have that Zn almost surely vanishes, and so the first conclusion of the theorem 
follows from the definition of Yn- Conversely if E|/i(A 2 ) — {Ph){Xi)\‘^ ^ 0, the 
second conclusion of the theorem follows immediately from the martingale central 
limit theorem and the law of iterated logarithm for martingales HU. 

We now expand the squares to get 

E\h{X2) - (Ph)(Ai)|2 = E{h{X2) - {Ph){Xi))(h{X2) - mix,)) 

= E|h(Ai)| 2 -E|(Ph)(Ai )|2 

= {h,h)^-{Ph,Ph)^ (28) 

= {{I-P*P)h,h)^. 

In the second equality, we have used that 

E(h{X2)(Ph){Xi)) = E{E(h{X2)\^i){Ph)(X,)) 

= E((Ph)(Ai)(Ph)(Ai)) 

= E|(Ph)(Ai)p. 

The operator I — P*P is Hermitian positive semidefinite, and hence the variance is 
0 if and only if {I—P*P)h = 0. In the case that A 7 ^ 1, the solution to {I—XP)h = g 
is unique, and hence we are done as this the only possible h that could satisfy the 
criterion in (1). If A = 1, the collection of h' for which (/ — XP)h' = g just differ 
from h by constant functions. Hence, P*Ph' = h' if and only if P*Ph = h. It 
remains to show the formula for the limiting variance of Z. We have that 

E|Zp= hm 5 ^=E|h(A 2 )-(Ph)(Ai)p. 

N—^oo 
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By (IMl) . we therefore have that 

E\Z\^ = ih,h)^-{Ph,Ph)^ 

= {h — XPh, h)^ + (XPh, h — XPh)^ 

= + i>'PK9)^ 

= {{{I -XP*)-^ + XP{I - XP)-^)g,g)^. 

These inverses always exist on the space of functions W. Expanding the inverses 
as Neumann series, we arrive at 

OO 

E|Z|2 = {g, g), + ^ \(tp*^g, g)^ + {X^P^g, 5 ). ■ 
k=l 

The desired formula for the variance now follows using the identities P^g{x) = 
E[ci(Xfe+i)|Xi = a;] and P*^g{x) = E [g{Xi)\Xk+i = x] . 

To show that the real and imaginary parts of Z are independent and have the 
same variance in the case A ^ K, observe that, again by the orthogonality of mar¬ 
tingale increments, 

N-l N-1 

EZ], = Y, EA2(*+i)(/i(X,+i) - {Ph){X,)f =E{h{X2) - {Ph){Xi)f Y 

i=l i=l 

In particular, if A ^ R, we have that 

F 72 

EZ^= hm ^ = 0. 

N—¥oo N 

This means that 

0 = EZ^ = E{^Zf - E(5Z)2 -p 2iE(5iZ5z). 

As (JiZ, 3Z) are jointly Gaussian and their covariance is 0, they are independent. 
Further, the variances of the real and imaginary parts match. 

□ 
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